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ABSTRACT 


The Aircraft Service Period Adjustment (ASPA) inspection/evaluation 
process for the Navy's S-3A Viking aircraft is presently a subjective 
assessment of the aircraft's general material condition. The purpose of 
this thesis is to quantify the ASPA inspection/evaluation process. The 
methodology used to quantify this process utilizes the Analytic 
Hierarchy Process (AHP) model. The AHP model is based upon three 
principles of logical analysis: (1) the principle of constructing 
hierarchies, (2) the principle of establishing priorities, and (3) the 
principle of logical consistency. This study presents a more efficient 
method of determining the aircraft induction decision than the current 
subjective ASPA procedures. Although the principle of _ logical 
consistency caused great concern amongst the authors, a methodology has 
been developed for quantifying the S-3A ASPA process that will assist 
NARF Alameda management in the control and documentation phase of the 


S-3A ASPA program. 


Teles 


lee 


TABLE OF CONTENTS 


INTRODUCTION . 
A. BACKGROUND . 
B. OBJECTIVE 
C, “SCORE 
D. PREVIEW. 
ASPA BACKGROUND. 
A. INTRODUCTION . 
B. ASPA PROCESS . . 
1. Program Acceptance Criteria. 
2. Responsibilities/Functions . 
C. EVALUATOR QUALIFICATION PROGRAM. 
D. SUMMARY. 


THEORETICAL FRAMEWORK OF THE ANALYTICAL 


HIERARCHY PROCESS: 


A... INTRODUCTION: 0 s0p ge eee ee eee 


B. THE ANALYTICAL HIERARCHY PROCESS . 
1. Struicturming=Hierarcaves- 
2. Setting PrionieneSacan 
3. Legical Consistency 

C. SUMMARY. . 

D. PREVIEW. 

AN EXAMPLE OF THE METHODOLOGY. 

A. AHP HIERARCHY STRUCTURE. 

B. PRIORITY DETERMINATION . 


. 1g 
ang 
. ll 
. Fe 


as 
. 14 
. ae 
eA 


ke 
ule 
. ve 
; 
dies 
aes 
., 38 
oul 
gia 
:- 3¢ 
cls 


C. CONSISTENCY OF THE ANALYTICAL HIERARCHY PROCESS. 
1. The Randomly Generated Consistent Matrix .. 
2. The Randomly Generated Matrix. 
3. Determination of the Consistency Ratio. . 
D. SUMMARY. 
Eo PREVIEW 
V. DEVELOPMENT OF AN OBSERVABLE SCALE . 
A. INTRODUCTION . 
Pee ROSS. 
C. SUMMARY. 
VI. SUMMARY, CONCLUSIONS AND RECOMMENDATIONS . 
A. SUMMARY. 
B. CONCLUSIONS. . 
GomeRECOMMENDATIONS. . . .. . te ee es ee 


APPENDIX A. S-3A LOCAL ENGINEERING SPECIFICATION . 
Peer x Bs S-3A VIKING ZONAL AREAS. 2... . 1 1. wee. 
PS ISOG REGERENCES ; 

NOS TRIBUTION LIST . 


. 38 
all 
, 44 
. 50 
. 51 
Ped 
ee 
, 52 
. 53 
. 58 
. 59 
. 59 
. 60 
. . 60 


OC 
ne 
ao 
eo 


iO. 


Hye 


War 
Ven 
14, 


on 


Oe 
ie 


LIST OF ELGURIES 


The Functional Hierarchy Structure 

Pairwise Comparison Matrix Example 

Normalized Pairwise Comparison Matrix Example 

ASPA Process Hierarchial Structure 

Structure of ASPA Pairwise Comparison Matrix 

The Pairwise Comparison Matrix for the S-3A Viking 

The Normalized Pairwise Comparison Matrix 

Row Sums and Priority Elements of the Pairwise Comparison Matrix 
The Randomly Generated Consistent Matrix 


Priority Elements of Pairwise Comparison Process Multiplied by 
Column Elements of Randomly Generated Consistent Matrix’ 


Row Sums, Lambda Max and Consistency Index of the Pairwise 
Comparison Matrix 


The Randomly Generated Matrix 
Normalized Randomly Generated Consistent Matrix 


Priority Elements of Randomly Generated Consistent Matrix 
Multiplied by Column Elements of Randomly Generated Matrix 


Row Sums, Lambda Max, Random Index and Consistency Ratio of the 
Randomly Generated Consistent Matrix 


Example Planner and Estimator (P&E) ASPA Worksheet 


Severity of Defect Ranking Structure 


AHP 
AIMD 
ASPA 
CFA 
el 
CR 
BCr 
D/Ma 
D/Mi 
DRP 
BoP 
FS 
ESP 
FES 
NALC 
NARF 
wy Cr 
0/Ma 
OSP 
P&E 
PED 
RI 
SDLM 


LIST OF ACRONYMS 


Analytical Heirarchy Process 
Aircraft Intermediate Maintenance Department 
Aircraft Service Period Adjustment 
Cognizant Field Authority 
Consistency Index 

Consistency Ratio 

Depot Critical Defect 

Depot Major Defect 

Depot Minor Defect 

Designated Rework Point 

Effective Service Period 

Field Support 

Initial Service Period 

Local Engineering Specification 
Naval Aviation Logistics Center 
Naval Air Rework Facility 
Organizational Critical Defect 
Organizational Major Defect 
Operational Service Period 

Planner and Estimator 


Period End Date 


Random Index 


Standard Depot Level Maintenance 


LIST OF DEFINI MONS 


Initial Service Period (ISP) The minimum time that aircraft in a 
reportable group ae pe are expected to both safely and 
economically remain in service following fleet introduction or 
SDLM. This time period can be expressed in terms of months, flight 
hours or number of cycles and serves as the milestone for the 
initial ASPA evaluation. The ISP can be lengthened based on the 
ASPA evaluation results. 


Local Engineering Specification (LES): Designed to assist depot 
level planners and estimators (P&E's) in the identification and 
correction of recurring, significant aircraft material maintenance 
conditions. 


Naval Air Rework Facility (NARF): Organization responsible for 
coordinating and conducting Standard Depot Level] Maintenance (SDLM) 


on fleet aircraft. 


Operating Service Months (OSM): Applied to specific aircraft 
bureau numbers (i.e., serial number) and is the calendar months 
Since acceptance/new or SDLM, whichever occurred last, less non- 
aging time (preserved and bagged). 


Operating Service Period (OSP): The number of calendar months 
between SDLM inductions that an aircraft can safely and economic- 


ally operate. 


Period End Date (PED): The month and year in which the current 
Operating Service Period expires for a given aircraft and is 
Subject to authorized adjustments (lengthening) resulting from ASPA 
evaluations or non-aging time. 


Standard Depot Level Maintenance (SDLM): Series of tailored 
maintenance actions applied to specific aircraft bureau numbers; 


typically follows aircraft completion of an operating service 
period. 


I, INTRODUCTION 


A. BACKGROUND 

The Aircraft Service Period Adjustment Program (ASPA) is now a 
reality for most aircraft in the U.S. Navy inventory. The primary goal 
of this program is the prevention of premature depot induction of fleet 
aircraft resulting in the unwarranted disassembly, inspection/evaluation 
and repair that Standard Depot Level Maintenance (SDLM) entails. The 
main feature of the ASPA program is an in-depth evaluation designed to 
reduce airframe maintenance budget costs and time spent overhauling 
airframe systems. 

The focus of this study deals with the quantification of the ASPA 
inspection/evaluation for the S-3A Viking aircraft. Built by Lockheed 
California Company, the S-3A has been the Navy's premier carrier-based 
antisubmarine platform designed to counter the surface and subsurface 
threat to the carrier battle group since 1975. The Viking incorporates 
both acoustic and non-acoustic sensors to enhance its weapon system in 
Support of its primary mission. As the Cognizant Field Authority 
(CFA)/Designated Rework Point (DRP) for the S-3A aircraft and related 
equipment the Naval Air Rework Facility (NARF), Alameda, California has 


managed the ASPA program for the aircraft since its inception in 1984. 


pee OBJECTIVE 
Present inspection/evaluation procedures entail the subjective 
assessment of an aircraft's material condition. Historically, this 


subjective non-quantitative approach appears to have some weaknesses. 


For example, inspections performed on the same aircraft by different 
ASPA inspectors have revealed inconsistent results. The primary purpose 
of this thesis is to attempt to eliminate this weakness by introducing 
quantifiable measures into the ASPA inspection/evaluation procedures for 


the S-3A in an attempt to provide consistency and objectivity. 


Ga SCC e 

Specifically, this thesis attempts to eliminate the inherent prob- 
lems associated with subjective evaluations through an application of 
the Analytic Hierarchy Process (AHP) model (developed by Thomas L. 
Saaty) to the ASPA inspection/evaluation. Aircraft general material 
condition is the primary criterion to be used in this approach. Consid- 
eration of cost factors was not possible due time constraints and lack 


of available data at the CFA/DRP level. 


D. PREVIEW 

Chapter II describes the evolution of the ASPA concept, and defines 
the process and key organizations involved. Chapter III presents an 
example utilizing the AHP methodology and its application to the S-3A 
ASPA program. Chapter IV discusses the relationship between the ASPA 
process and the principles of the AHP. Chapter V develops an observable 
scale which correlates ASPA inspection results to a weighted scale. 


Chapter VI presents conclusions and recommendations. 
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II. ASPA BACKGROUND 


The Department of the Navy (DON) has entertained various approaches 
to aircraft maintenance in an effort to preserve and maintain fleet 
operational readiness. The DON's main objective has been to reduce 
total program maintenance costs by judiciously applying scarce depot 
rework assets as necessary without sacrificing fleet operational readi- 
ness. 

In the early 1970's, for example, the DON implemented a program 
similar to the Aircraft Service Period Adjustment (ASPA) program en- 
titled "Aircraft Condition Evaluation" (ACE). Unfortunately, introduc- 
tion of the ACE program significantly increased organizational (0-level) 
Maintenance man-hours which revealed less than optimal results; there- 
fore, an unacceptable number of fleet aircraft were in a non-flight 
(disassembled) status for extended time periods. It was readily appar- 
ent to the DON that this maintenance philosophy (and others like it) 
resulted in poor budgeting practices and difficulty in quantifying depot 
level maintenance airframe requirements. Therefore, in 1982 the Naval 
Aviation Logistics Center (NAVAVNLOGCEN) proposed the ASPA program as a 
means of deferring SDLM for fleet aircraft by adjusting the Period End 
Date (PED). As a part of the Planning, Programming and Budgeting System 
(PPBS), the ASPA program is a significant departure from previous 
approaches. In contrast to the ACE program, ASPA provides a methodology 
for reducing maintenance costs in spite of ever-increasing material 


costs and wages. [Ref. 1:p. 5] The remainder of this chapter is devoted 


je 


to a description and discussion of the significant aspects of the ASPA 


concept, process and key participants. 


A. INTRODUCTION 

The ASPA program philosophy focuses on the delicate, ever-changing 
balance between costs and readiness. The purpose of the program is 
two-fold. The primary purpose is to reduce maintenance costs of air- 
frames (SDLM costs) by lengthening the aircraft's operational service 
period (OSP). An important aspect of the primary purpose is 

to identify those aircraft that are in significantly better 
condition than that warranting depot induction for the detailed 
disassembly, inspection and repair that SDLM entails. Airframes which 
meet the ASPA criteria are proposed for a twelve-month deferral of 
SDLM induction and that amount of time is added to the individual 
aircraft's Period End Date (PED). Aircraft failing an ASPA inspection 
must be inducted for SDLM as soon as possible, but in no case more 
than 90 days beyond the PED, or be grounded. [Ref. 2:p. 1] 
In direct support of the primary, a secondary purpose is 

to define the airframe depot maintenance requirements based on 
actual assessment of the individual aircraft's material condition 
rather than a statistical prediction (j.e., rework on an as-needed 
basis) [Ref. 2:p. 1]. 

ASPA is based on the premise that fleet aircraft, regardless of 
community type, will have a wide distribution of observable material 
conditions (due to differing flight environments - shore, carrier based, 
climate, etc.) at any particular point during service life or following 
any given number of individual aircraft operating hours. The mean level 
of material degradation that is expected at the PED may very well be 
considered "fleet average" for that particular aircraft type. Recent 


evidence, however, has recorded degradation levels for a specific 


aircraft which are lower than expected at the PED thereby allowing such 


li 


an aircraft to be safely kept in active service with no significant 


ingaeemonereaathness wer costs. |Ref. 3:pm 17] 


B. ASPA PROCESS 

The ASPA process involves complex interaction and coordination 
between the cognizant field authority (CFA)/Designated Rework Point 
(DRP) and operational level activities (squadron). Historically, the 
end of the operating service period has been signalled by the PED, 
however, the implementation of the ASPA program revises this perspec- 
tive. Typically, fleet aircraft material condition is evaluated within 
the "ASPA window" or time frame which is normally six months prior to 
the PED. For those aircraft being deferred, elapsed time between the 
ASPA evaluation and the adjusted PED normally does not exceed 18 months; 
therefore, the deferral is for a maximum 12-month period. Induction 
into field support (FS) custody no later than ninety calendar days 
following PED is mandatory for those aircraft not recommended for PED 
adjustment. Those recommended for adjustment may have an unlimited 
series of aircraft material condition evaluations. ERG meme) 7. | 

It is appropriate at this point to describe the ASPA program 
acceptance criteria and briefly discuss the responsibilities and 


functions of the key players involved in the ASPA process. 


1. Program Acceptance Criteria 


Aircraft under consideration for the ASPA program must meet the 
following conditions: 


(a): Only aircraft approaching their first tour (initial fleet | 
operational in-service period) extensions are eligible. 


IRS: 


(b) For transition (to ASPA) purposes, aircraft can be inspected as 
early as six (6) months prior to their PED. 


(c) Once an aircraft is on the ASPA schedule it will remain on the 
schedule. 


(d) Subsequent ASPA inspections will be performed 90 days prior to or 
30 days after the aircraft's PED. (SDLM normally commences at 
PED but due to operational requirements, a 30-day extension can 
be granted.) 

(e) Aircraft currently on an extension program will remain on that 


program until the aircraft starts a new tour (normally starts 
following SDLM). 


2. Responsibilities/Functions 


a. Cognizant Field Authority (CFA) Involvement/Designated 
Rework Point (DRP) Involvement. 


Establishment of ASPA examination and evaluation require- 
ments, PED adjustment criteria, and program management as applied to 
operational aircraft custodians (squadron) is the direct responsibility 
of the CFA which is, for the purpose and scope of this thesis, the Naval 
Air Rework Facility (NARF) Alameda [Ref. 3:p. 17]. 

Effective and efficient execution of the ASPA process 
requires proper management and coordination at three levels within the 
NARF Alameda management framework. 

ASPA Program Level. Coordination at this level involves the 
S-3A Engineering Branch (to include Branch Head, engineers, Planners and 
Evaluators, etc.). It establishes policies and procedures within the 
CFA/DRP structure. 

Command Level. Responsible for establishing “consistency of 
purpose, timeliness and application of ASPA to the various aircraft 
programs assigned. An internal organization must be identified that 


consists of those major elements of the CFA/Prime DRP organization 
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having functional and/or program assignments that support the attainment 
of the ASPA objectives" [Ref. 3:p. 20]. 

Aircraft Program Level. Coordination at this level is the 
responsibility of both the CFA/Prime DRP and a DRP ASPA participant 
(i.e, NARF Alameda/S-3 Division and fleet squadron). The prime objec- 
tives of this level, in terms of coordination, are to ensure effective 
execution and uniform interpretation of Local Engineering Specifications 
(LES) by properly trained and qualified ASPA evaluators. Also, it is 
necessary to minimize the effect on fleet operations of problems (air- 
craft down-time, inspection scheduling, man-hours required, etc.) 
associated with conducting ASPA conditional MRC's. The management 
effort should facilitate timely data generation, feedback analysis and 
analytical reporting as well as actions necessary to correct material 
impediments or defects uncovered as a by-product of the ASPA inspection 
(i.e., ensuring that all discrepancies are properly documented by the 
aircraft custodian maintenance activity). [Ref. 3:pp. 20-21] 

b. Organization (Squadron) Level Involvement. 

The requirement to meet all operational commitments and to 
request, schedule and prepare aircraft and their operational/maintenance 
records for the ASPA inspection and evaluation is the direct respon- 
sibility of the reporting custodian (squadron) of the aircraft as the 
on-site representative of the Aircraft Controlling Custodian (ACC). In 
preparation for the ASPA inspection, with direct assistance and support 
from the CFA/Prime DRP, the squadron maintenance department should 
ensure that ASPA Maintenance Requirement Cards (MRC's) be prepared and 


validated in order to restore the aircraft, if necessary, to meet the 
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i" i 


minimum material status (i.e., the aircraft is required to be in an “up 


status) required for ASPA inspection eligibility. [Ref. 3: pp. 19-20] 


C. EVALUATOR QUALIFICATION PROGRAM 
In order to ensure that ASPA inspection and evaluation requirements 
are consistently applied, evaluator qualification standards are neces- 
sary. The need for consistent application of inspection procedures, 
with respect to the accuracy of inspection results, is quite critical 
Since ASPA evaluations are presently subjective in nature. 
1. ASPA Evaluator Requirements 
Qualifications for an individual desiring designation as an ASPA 
examiner is established by the Maintenance Engineering Cognizant Field 
Activity (MECFA) for aircraft programs under its cognizance. Typically, 
the qualifications are expressed in terms of desired experience levels 
(avionics, structural or hydraulics technician), required training or a 
combination of both, and are coordinated within the production 
department of the respective CFA to ensure that consistent, relevant 
requirements are maintained. 
2. ASPA Evaluator Selection 
The selection of prospective ASPA evaluators is under the 
control of the CFA production department with a MECFA representative as 
a participating member of both the rating and selection panels [Ref. 3: 


pp. 34-35]. 
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D. SUMMARY 

This chapter has discussed the development and objectives of the 
ASPA concept and key organizations involved because the purpose of this 
thesis is to develop a methodology for quantifying the ASPA inspection 
and evaluation process for the S-3A aircraft. Chapter [II will address 
and describe the Analytical Hierarchy Process (AHP) model selected by 
the authors to provide this quantification. The details of the ASPA 
procedure for evaluating an aircraft's material readiness and a 
discussion of the relationship between the ASPA process and the AHP will 
be addressed in Chapter IV. Chapter V discusses the development of an 
observable scale for correlating ASPA inspection results to a weighted 
Scale providing the necessary link to completely quantify a previously 
Subjective process. Chapter VI presents a summary, conclusions and 


recommendations. 
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TTI. THEORETICAL FRAMEWORK OF THE ANALYTICAL HIERARCHY PROCESS 


A. INTRODUCTION 

The major research question of our thesis was to quantify a pre- 
viously subjective process in a manner which was consistent and logical. 
In our searcn for a model or methodology that would help answer this 
question, we decided to seek out a process which combined deductive and 
inductive approaches of the mind in an integrated and logical framework. 

The human mind organizes decision making methodology into two broad 
categories. The first category is the deductive or logical approach, 
and the second category is the inductive or systems approach. The 
logical categorization entails the analysis of a system via a generic 
networking scheme whose structure consists of various interconnected 
chains and cycles. Once the human mind structures the network it is 
easier to explain the function of each individual component and, by 
Synthesis, the network is defined. The most serious drawback of the 
logical approach is that the feedback concept is not utilized. To 
correct for this omission, the human mind must employ the inductive 
approach, which looks at the general or holistic perspective and ignores 
each individual component's function. Clearly, both the deductive and 
inductive approaches contribute to the human mind's ability to 


understand and analyze complex svstems. [Ref. 4:p. 5] 


B. THE ANALYTICAL HIERARCHY PROCESS 
The model which seems to best satisfy our criterion is the Analytic 


Hierarchy Process (AHP) developed by Dr. Thomas L. Saaty. The Analytic 
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Hierarchy Process is based upon three fundamental principles of logical 
analysis [Ref. 4:p. 17]: 

(1) The principle of constructing hierarchies. 

(2) The principle of establishing priorities. 

(3) The principle of logical consistency. 
In the following sections of this chapter we will explain how the 
Analytical Hierarchy Process can be utilized to quantify the currently 
subjective S-3 Viking Aircraft Service Period Adjustment (ASPA) program. 

Presently, the S-3 ASPA inspection is done by a Naval Air Rework 
Facility (NARF) Planner and Estimator (P&E). The P&E evaluator inspects 
the subject aircraft in accordance with the NARF Alameda S-3 ASPA Local 
Engineering Specification (LES) (Appendix A). A unique feature of the 
S-3 ASPA inspection is that zonal areas fi.e., the fuselage, rudder 
assembly, horizontal stabilizer, etc.) are inspected for deterioration 
instead of a leading indicator examination methodology (i.e., the hinges 
of the rudder assembly). 

Since the zonal area inspection method could produce many diScrep- 
ancies ranging in severity from organizational to depot level repair 
required, we attempted to quantify the ASPA evaluation by weighting the 
various discrepancy categories available for assignment by the P&E 
evaluator. The first step in accomplishing this objective utilizing AHP 
was to structure a hierarchy of the problem being studied. 

Pe EUCtUrINGenlerancnies 

Saaty [Ref. 4:p. 17] expresses this view of the structuring of 
hierarchies: 
Humans have the ability to reduce a complex problem into various 


levels and sublevels as many times as necessary to simplify the 


19 


comprehension process. By the use of hierarchies one can show how 
changes in emphasis or priority on an upper level will effect the 
final outcome at the lower levels. 

Since we are trying to quantify the S-3 ASPA process via logical, 
analytical thinking (the main characteristic of AHP) we must structure 
the ASPA process in a manner which allows us to study each decision 
level independent of the ASPA process as a whole. The use of a 
functional hierarchy helped to accomplish this goal. 

The basic decision levels of the functional hierarchy are the focus, 
criteria, subcriteria and alternatives stage (Figure 1). The focus of 
the hierarchy is the broad, overall objective of the problem being 
Studied. In the case of the ASPA evaluation process, the overall 
objective of the program is to identify aircraft for induction into 
Standard Depot Level Maintenance (SDLM) rework. The criteria of the 
hierarchy represents the forces which influence the focus. The major 
influential force in the determination of SDLM rework, according to the 
ASPA process, is the general material condition of the specific aircraft 
being inspected. The subcriteria of the functional hierarchy are the 
actors which determine the criteria. In our case, the subcriteria are 
the specific zonal areas the P&E evaluators inspect (Table 1 and 
Appendix B). These zonal areas are assigned a subjective grade, which 
is used by the P&E evaluator in his final determination of the generai 
material condition of the aircraft. The final decision level of the 
functional hierarchy is the "possible alternatives" stage. This level 
of the hierarchy represents possible scenarios available within the ASPA 
process. Two courses of action are possible at this level: induct the 


aircraft or do not induct the aircraft into SDLM rework. 
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TABLE t. S-3 VIKING ASPA INSPECTION ZONES 


_ LEFT-HAND WING FOLD: OUTER WING PANEL 


LEFT-HAND WING FOLD: INNER WING PANEL 


. RIGHT-HAND INNER WING PANEL SPAR AND FLAP WELL 

. RIGHT-HAND OUTER WING PANEL AFT SPAR AND FLAP WELL 
_ RIGHT-HAND OUTER WING PANEL, TAB AND SPAR 

. RIGHT-HAND WING FOLD: OUTER WING PANEL 

. RIGHT-HAND WING FOLD: INNER WING PANEL 

. LEFT-HAND INNER WING PANELSPAR AND7 2 wee 


LEFT-HAND OUTER WING PANEL AFT SPAR AND FLAP WELL 


HORIZONTAL STABILIZER 
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IN FOLD 


. RUDDER 

. FUSELAGE 

. ENVIRONMENTAL CONTROL SYSTEM COMPARTMENT 
. LEFT-HAND MAIN LANDING GEAR AND WELL 

. RIGHT-HAND MAIN LANDING GEAR AND WELL 

. NOSE LANDING GEAR AND WELL 

OVERALL PAINT CONDITION 
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Once the hierarchial structure of the ASPA process had been spec- 
ified the next step is to determine the priorities between each decision 
level and every element within those levels. 

eeeocteing Priorities 

The human mind has an innate ability to perceive relationships 
between items or facts we observe and assigns a relative importance to 
that event. By employing the Analytical Hierarchy Process in our study 
of the quantification of the S-3 ASPA program we have chosen a 
methodology that takes advantage of this thought process. 

The level of the functional hierarchy that required prioriti- 
zation was the subcriteria decision level. This level corresponds to 
the zonal area subjective judgments which are dominant in the ASPA 
evaluation process because the results of this level determine the 
induction decision. To answer our major research question we had to 
determine the relative priority, or percent contribution, each zonal 
area made to the criterion of general material condition and hence, the 
induction decision. 

The first step in establishing the relative priorities of the 
Subcriteria level was to construct a Pairwise Comparison Matrix. This 
matrix allowed the NARF Alameda P&E's to compare each element (zonal 
area) against the other zonal areas and judge their impact on general 
material condition [Ref. 4:p. 76]. The matrix structure is a mathemati- 
cal tool that is well suited for this process (Figure 2). 

To begin the pairwise comparison process, the Analytical Hier- 
archy Process takes the first zonal area of the left-hand column and 


compares it to each zonal area in the top row. This process continues 


as 


oa, dwexy XluzeWy uostueduiojg astmuLegd “2 ounbl4 


Views FD CO! SWAS NWN109 


ee OG $ 


fl OS | | SVdIdV IWNOZ 





NOILIQNOO IVIdSLVYW 1VadN39 
SVsIaV INOZ NOIAILIAD 


24 


working down the left-hand column until the matrix is completed. An 
important point to consider during the pairwise comparison process is 
the phrasing of the comparison question. The left-hand column is always 
compared to the top row to maintain the proper relationship between 
zonal areas with respect to the criterion of general material condition 
meer. 4:p. 77). 

To assign a relative importance to each comparison a numeric 
scale has been developed by Saaty [Ref. 4:p. 78]. Table 2 presents the 
values available for assignment during the pairwise comparison process. 
This graduated scale represents the degree of intensity of which the 
human mind is capable of distinguishing between. 

As an example of how AHP works to this point, refer to Figure 2 
again. When Zonal Area One of the left-hand column was compared to 
Zonal Area One of the top row an intensity of importance factor of one 
(1) was assigned. By consulting Table 2, the definition of this inten- 
sity of importance factor is “equal importance of both elements". This 
point will be true whenever a zonal area is compared to itself, thus the 
diagonal of the Pairwise Comparison Matrix will always contain unity. 

Zonal Area One was then compared to Zonal Area Two and the 
example intensity of importance was determined to be five (5), which is 
defined as "essential or has a strong importance of one element over 
another". When Zonal Area One was compared to Zonal Area Three it was 
determined that area Three was more important by a factor of nine (9). 
This situation requires the use of reciprocal factors. When the top row 


area dominates, or iS more important than the left-hand column area, the 


Zo 


TABLE 2. THE PAIRWISE COMPARISON SCALE 


Intensilyv of 
[mportance 


fd 


2,4,0,8 


Definition 


Equal importance of both 
eleiienps 


Weak importance of one 
element over another 


Essential or there exists a 
a strong importance of one 
element over another 


Demonstrated importance 
of one element over another 


Absolute importance of one 
element over another 


Intermediate values be- 
tween two adjacent judge- 
ments 


ae 


Explanation 


Two elements contribute 
equally to the propertv 


Experience and judgement 
Shightiv favor one element 
over another 


Experience and judgement 
strongly favor one element 
over another 


An element is strongly 
favored and its dominance 
is demonstrated in prac- 
tice 


The evidence favoring one 
element over another ts of 
the highest possible order 
of affirmation 


Compromise is needed 
between two judgements 


reciprocal intensity of importance factor is assigned. Therefore, the 
comparison in our example is assigned the factor 0.11. 

The use of reciprocal factors also leads to a reduction in the 
work the evaluator must do when completing the matrix. Once _ the 
triangle above the diagonal is assigned the proper intensity of 
importance factors, the triangle below the diagonal can be completed 
through inference by entering the symmetrical reciprocal values as shown 
imerigure 3. 

The final zonal comparison is made between Zonal Area Two and 
Zonal Area Three with the resulting assignment of an example intensity 
of importance factor of three (3). When the pairwise comparison process 
is finished, the next step of the AHP is to determine the relative 
importance of each zonal area with respect to the stated criterion of 
general material condition. 

The first step in determining this value, termed the priority 
vector, is to sum each column of the matrix and divide each pairwise 
comparison factor by this sum to attain a normalized matrix (Figure 3). 
The normalized matrix permits a more meaningful comparison among zonal 
areas. ([Ref. 4:p. 80] 

Finally, the normalized zonal areas are summed by row and this 
Summation is divided by the number of zonal areas in the row [Ref 4:p. 
81]. The result of this normalized matrix row averaging is the percent- 
age of overall relative priority for each zonal area with respect to the 


criterion of general material condition (Figure 3). 
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Soeeeoouea| Consistency 


Logical consistency is the third principle of the Analytical 
Hierarchy Process. Saaty [Ref. 4:p. 18] describes consistency as: 

: .A trait that the human mind accomplishes in both the conscious 
and unconscious states. Humans have the ability to relate similar 
items, ideas and events in a harmonious manner for more efficient 
Storage within the brain. Once the homogenous clumps have been filed, 
the intensity of the relationships are worked upon by the unconscious 
State of the mind by the application of a specific criterion with the 
result being either a strengthening or weakening of the individual's 
original classification scheme. 

Since the pairwise comparison process was conducted by the S-3 
Planning and Estimating (P&E) Branch of Naval Air Rework Facility (NARF) 
Alameda, a check for consistency of their subjective and experienced 
judgments was in order and is presented in Chapter IV. 

The consistency check advocated by Saaty involves the generation 
of a random pairwise comparison matrix. The idea of generating a random 
matrix allows us to compare truly random judgments versus the experi- 
enced judgments of the P&E evaluators. The deviation from consistency 
that results from this comparison is termed the Consistency Index (CI), 


and is expressed mathematically as: 


CI = lambda max - n 
n- l 


where n equals the number of zonal areas (twenty in our problem) in the 
Pairwise Comparison Matrix. 

Lambda max (the principle eigenvalue) of the CI equation is 
found by multiplying the zonal area priority vectors, as calculated in 
the pairwise comparison process, by each columnar element of the 
randomly generated matrix. The new row values are then summed and this 


Summation 1s divided by the corresponding priority vectors of each zonal 


ao 


area. The mathematical average of these quotients is found and this 
numerical value represents Jamda max. [Ref. 4:p. 84] 

Once the Consistency Index of the Pairwise Comparison Matrix is 
found, a value termed the Random Index (RI) must be calculated. The RI 
is simply the consistency index of the random matrix. This value was 
calculated in the same manner as the CI and is presented in Chapter IY. 

When the Consistency Index and Random Index have been cal- 
culated, the overall process consistency, or the Consistency Ratio (CR), 
can be found [Ref. 5:p. 21]. The Consistency Ratio is expressed as: 


CR = C 


-+ 


AO 
— 


The acid test for consistency via the Analytical Hierarchy Process is to 


obtain a CR less than ten percent [Ref. 5:p. 21]. 


C. SUMMARY 
In this chapter we have presented the theoretical background 
necessary to understand how Saaty's Analytical Hierarchy Process works. 
We have emphasized that the AHP is based upon three fundamental 
principles of logical analysis: 
(1) Constructing hierarchies 
(2) Establishing priorities 
(3) Maintaining logical consistency 
These three principles set the framework upon which this chapter is 
Structured. Within this framework we have outlined the procedures that 
must be accomplished when utilizing the Analytical Hierarchy Process to 


solve a complex problem. 
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D. PREVIEW 

In Chapter IV we will apply the three principles of the AHP to the 
S-3 ASPA process in an attempt to quantify a previously subjective 
process. By generating priority values for each zonal area of the S-3A 
Viking we will be able to generate an ASPA score that can be utilized in 
the determination of the induction decision instead of using the 


subjective judgment of the P&E evaluator. 


ay 


TV. AN EXAMPLE OF THE METHODOLOGY 


A. AHP HIERARCHY STRUCTURE 

According to the Naval Aviation Logistics Center (NALC), the purpose 
of the ASPA program is to determine whether the specific aircraft being 
evaluated should or should not be inducted into Standard Depot Level 
Maintenance (SDLM) rework. The most important criterion used in accom- 
plishing this decision is the general material condition of the aircraft 
at the time of the ASPA evaluation. Thus, the first two levels of our 
AHP hierarchy are mandated by NALC. Level One, or the focus of the 
hierarchy, is the SDLM induction decision and Level Two, or the criter- 
ion of the hierarchy, is the general material condition of the aircraft 
being evaluated. 

The third level of the AHP hierarchy is defined as the subcriteria 
level. The subcriteria level of the hierarchy contains the variables 
necessary for determining the general material condition of the 
aircraft. These variables are defined by the NARF Alameda S-3A Local 
Engineering Specification (LES) of 7 Aug 1985 (Appendix A). 

The LES provides a detailed and comprehensive checklist of items to 
be inspected in the determination of an aircraft's general material 
condition. The P&E evaluator uses the LES during each ASPA evaluation 
and notes discrepancies in each zonal area by severity of defect (An 
example of a zonal area would be the fuselage of the aircraft and a 
common discrepancy would be chipped paint requiring an organizational 


level maintenance action to repair). 


By 


When the ASPA evaluation is complete the P&E evaluator totals the 
number of discrepancies and subjectively determines the overall general 
material condition of the aircraft. Based on this determination, the 
P&E evaluator either recommends that the aircraft be inducted into SDLM 
rework or remain on operational duty. This induction decision repre- 
sents the fourth level of the AHP hierarchy, the possible alternatives 
Stage. Figure 4 presents a diagrammatic view of the completed hierar- 


chial structure as it applies to the ASPA evaluation process. 


B. PRIORITY DETERMINATION 

By incorporating the zonal areas of the S-3A LES into the sub- 
criteria of our hierarchy, we are proposing a method of reducing the 
subjectivity which currently exists within the ASPA evaluation process. 
Instead of a subjective input being used as the determining factor of an 
aircraft's material condition, we will employ the methodology of AHP to 
determine each zonal area's relative contribution (expressed as a 
percentage) to the criterion of general material condition. 

The AHP methodology employs the use of a matrix to determine the 
relative contribution of each element (zonal area) being studied. 
Figure 5 presents the Pairwise Comparison Matrix structure for the S-3A 
aircraft. As can be seen from this figure, the matrix provides a tool 
for comparing each zonal area to all of the zonal areas. 

The development of the Pairwise Comparison Matrix is the first step 
we will use to quantify a previously subjective process. The pairwise 


comparison process represents the P&E evaluator's decision regarding 


5:3 


BUNIINATS PRLYDUPUSLH SSBd0Ug WdSW ‘ph a4NbL4 


LINGN! LON OO LIMON | 


Vidv IVWNOZ VidvV_IWNOZ 






NOILIGNOD IWIddLVW IVAadaN39 


NOILINGNI W105 


SIAILYNASL TY 


VidsLlidg-gns 


NOIdd Lido 


SMIO4 


i “lian 


= ise 


1 \Vaveel 


= Veiver) 


34 


CRITERIA ZONAL AREAS 
GENEP AL MATERIAL CONDITION [1 23456789 101112131415 16171819 20 





WON DOW BWN —- 


ZONAL AREAS 10 


LIST OF ZONAL AREAS: 


_LH WING FOLD: OUTER WING PANEL 

_LH WING FOLD: INNER WING PANEL 

_RH INNER WING PANEL SPAR & FLAP WELL 
_RH OUTER WING PANEL AFT SPAR & FLAP WELL 
RH OUTER WING PANEL, TAB & SPAR 

_RH WING FOLD: OUTER WING PANEL 

_RH WING FOLD: INNER WING PANEL 

_LH INNER WING PANEL SPAR & FLAP WELL 
_LHOUTER WING PANEL AFT SPAR & FLAP WELL 


10. HORIZONTAL STABILIZER 

11. LH ELEYATOR & TAB 

12. RH ELEYATOR & TAB 

VSI FCLO 

14. RUDDER 

15. FUSELAGE 

16. ECS COMPARTMENT 

17. LH MAIN LANDING GEAR & WELL 
18. RH MAIN LANDING GEAR & WELL 
19. NOSE LANDING GEAR & WELL 
20. OVERALL PAINT CONDITION 


Figure 5. Structure of ASPA Pairwise Comparison Matrix 
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which zonal area is most important/critical to the general material 
condition of the aircraft when matched against the other zonal areas. 

The possible decisions the P&E evaluator could make within the 
Dairwise comparison process were previously presented in Table 2 of 
Chapter III. The numerical scale ranges in intensity of importance from 
one (equal importance of both elements) to nine (absolute importance of 
one element over another). These values are assigned by comparing the 
zonal areas of the left-hand column to the zonal areas in the top row. 
The emphasis on order of comparison is necessary to produce a ranking 
which is relative to our stated criterion of aircraft general material 
condition. 

As described in Chapter III, during the pairwise comparison 
process a zonal area which is considered more important than the zonal 
area it was being compared to was assigned a whole number. If the area 
is less important then the reciprocal intensity of importance is 
assigned. Figure 6 presents the Pairwise Comparison Matrix for the 
S-3A. This matrix was developed by a senior NARF Alameda P&E with the 
assistance of one member of the S-3A Engineering Branch. Consider, for 
example, Zonal Area 14, listed in the left-hand column of Figure 6. 
This area of the aircraft is the rudder assembly of the S-3A. When the 
rudder assembly was compared to the overall paint condition (Zonal Area 
20) the P&E evaluator decided that the rudder was more important to the 
criterion of general material condition of the aircraft by an importance 
factor of three (3). The assignment of an intensity of importance 
factor of three means the P&E evaluator felt that the rudder assembly 


exhibited "a weak importance" over the paint condition in_ the 
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determination of overall general material condition of the aircraft. 
When the rudder assembly was compared to the aircraft's fuselage (Zonal 
Area 15) the fuselage was adjudged to be more important with the 
resultant assignment of an importance factor of 0.25, or the reciprocal 
of four (4). The assignment of an intensity of importance factor of 
0.25 indicates the P&E evaluator felt that this comparison ranked 
between ‘weak importance" and "essential or there exists strong 
importance" of the fuselage over the rudder assembly. 

Once the matrix is filled, the procedure for determining the 
relative contribution (priority vectors) of the zonal areas can begin. 
First, all columns are totalled and the sum divided into all the ele- 
ments within the respective column. The result of this calculation is a 
normalized matrix as presented in Figure 7. The row sums of the 
normalized matrix are calculated next and then divided by the number of 
elements in the row, which is twenty (20). The end result of these 
Simple mathematical calculations is the relative priority vector, or the 
relative contribution each zonal area makes to the overall general 


material condition of the aircraft (Figure 8). 


C. CONSISTENCY OF THE ANALYTICAL HIERARCH TS pRGGes. 

As mentioned in Chapter III, the Analytical Hierarchy Process should 
provide consistent results. In this section we will present’ the 
methodology used to calculate a numerical value for consistency as it 


applies to our problem. 
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ROW PRIORITY 

SUMS ELEMENT 

Crea 0.020355 
2 0.40908 0.02045 
S 0.44096 0.02205 
4 OZ 545 0.01616 
2 Oo 0.01806 
6 Oe cryit 0.02416 
a 0.36056 0.01803 
8 OA PZZ26 0.0206 1 
9 OS 5520 0.01766 
10 Zoo Oe ieter 
11 1 Caan aay 0.08889 
IZ L7S062 0.08653 
12 Oars 0.00897 
14 1 O29i3 0.05146 
1S 5.00147 0.15007 
16 0.296635 SAO ace 
Ey bre | ee 0.08587 
18 er 0.08587 
[2 1.71741 0.08587 
20 One4 a4 0.04922 


Figure 8. Row Sums and Priority Elements of 
the Pairwise Comparison Matrix 
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1. The Randomly Generated Consistent Matrix 


To confirm that the judgments offered by the P&E evaluators were 
logical, and not merely random, we compared the Pairwise Comparison 
Matrix to a Randomly Generated Consistent Matrix. The intent of this 
comparison was to determine a value called the Consistency Ratio (CR), a 
numerical measure of AHP's consistency. The CR is derived by finding 
the Consistency Index (CI) of the Pairwise Comparison Matrix and 
dividing this value by a factor known as the Random Index (RI). The 
Randomly Generated Consistent Matrix is a matrix generated by a random 
number generator using the same intensity of importance scale as was 
Meed for the Pairwise Comparison Matrix (0.11, 0.13, 0.14, 0.17, 0.2, 
0.25, 0.33, 0.5, 1 through 9). The matrix is termed consistent because 
the upper right triangle (above the diagonal) was generated, and the 
transpose positions (lower left triangle) were filled with the 
reciprocal values (Figure 9). 

The calculation of the Consistency Index of the Pairwise Compar- 
ison Matrix begins with the multiplication of the elements of the 
priority vector by each corresponding column element of the Randomly 
Generated Consistent Matrix. For example, the priority vector element 
for Zonal Area 15 (fuselage) is 0.15007. When this value is multiplied 
by the first element, 0.17, of the fifteenth column of the Randomly 
Generated Consistent Matrix a value of 0.02551 is obtained, as can be 
seen in Figure 10 (row 1, column 15). 

The next step in the process is to sum the rows of Figure 10 and 
divide this summation by the respective priority vector elements of the 


zonal areas. These quotients are then averaged to find a value termed 
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"lambda max". Lambda max is a key variable in the mathematical equation 
for the Consistency Index: 


CI = lambda max - n 
n- 1 


where n represents the number of elements in the sample, in this case, n 
equals 20. 

The Consistency Index for tne S-3A Pairwise Comparison Matrix was 
found to be 2.86555 as shown in Figure ll. 

2. The Randomly Generated Matrix 

To calculate the Random Index, or the random value of the 

Consistency Index, we must generate another random matrix (Figure 12). 
This matrix differs from the Randomly Generated Consistent Matrix in 
that all of the elements of this matrix were generated by the random 
number generator and not just the upper right triangle. To find the 
Random Index we first normalize the "consistent" matrix and determine 
the priority vector elements (Figure 13). Once the priority vector of 
the Randomly Generated Consistent Matrix is known we multiply these 
values by their respective column entries in the random matrix (Figure 
14). The row sums are calculated and these values are divided by the 
applicable priority vector elements to obtain the values in Figure 15. 
Lambda max is found in the same manner as for the Consistency Index. 
The lambda max value is then inserted into the equation for the Random 
Index: 


RI = lambda max - n 
n- 1 


and the Random Index is found to equal 3.72625 (Figure 15). 
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ZONAL ROW PRIORITY 
AREAS SUMS ELEMENT 
1.59977 73.71 07 
a 2.48213 12 noes 
5 5.26398 148.130 
4 2.01818 PZ 
S ZO! Poerood 
6 1.62880 67.4255 
7 1.45650 80.7919 
8 2.5050 1 RRS 25 
9 0.92603 Daa ooe 
10 Potoo® omoa 
11 3.05747 54.3966 
eZ Boel? 26.6065 
15 ie S Poona 
14 1.77878 34.5687 
IS ZOOZG7 19.3446 
16 Secs ZeoalO/ 
17 Ploeos Toago 
18 1.97314 22.9781 
19 Zo) .9 29.698 | 
20 1.97871 B20 52 


COLUMN SUM = 1488.91 


LAMBDA MAX.= 74.4454 


C.1. = 2.86555 


Figure 11. Row Sums, Lambda Max and Consistency 
Index of the Pairwise Comparison 
Matrix 
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Normalized Randomly Generated Consistent Matrix 


Figure 13. 
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ZONAL ROW PRIORITY 
AREAS SUMS ELEMENT 
1.99977 nally 
Z 2402S PZ SoS 
5 3.26598 148.130 
4 2.01818 Aaa 
S Zo | 135.690 
6 1.62880 67.4255 
ii 1.45650 80.7919 
8 2.5050 1 111.8235 
g O9Z505 et Oo 
10 oo oU 16.9494 
11 ora) 54.5966 
12 Cee 26.6065 
ie 9726 [oon 
14 1.77878 54.5687 
1S Zee fs. 5446 
16 Seon g0 ZNO 
taf imbocod foe 
18 ietaon ct ZA S | 
19 2.99019 29.6981 
20 ipovon | One 


COLUMN SUM= 1488.91 
LAMBDA MAX.= 74.4494 


C.1. = 2.86555 


Figure 15. Row Sums, Lambda Max, Random Index and 
Consistency Ratio of the Randomly 
Generated Consistent Matrix 
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3. Determination of the Consistency Ratio 


Once the Consistency Index of the Pairwise Comparison Matrix and 
the Random Index of the Randomly Generated Consistent Matrix are known 
the Consistency Ratio can be calculated by the following formula: 


CR = Cl = 2.86c050e-80.767ila 
| 397 2625 


7 


This value, in our opinion, is too far from the AHP goal of 0.10 
to be considered a consistent result. Two factors that may have 
contributed to this unsatisfactory result are: 


(1) The judaments of the P&E evaluator used in the Pairwise 
Comparison Matrix were randomly chosen. 


(2) The Random Index of the Randomly Generated Consistent Matrix is 
not as accurate as it could be. 


We feel that factor (2), the inaccuracy of the Random Index, 
deserves a more in-depth explanation at this time. Saaty and his 
colleagues have worked extensively at developing average Random Indexes 
for matrices of order 1 to 15. [Ref 5:p. 21]. They have generated 
hundreds of matrices at each order and then averaged the resulting 
Random Indexes. What we have done, due to resource constraints, is 
generate one Random Index for a 20 by 20 matrix. In effect, we have 
been unable to follow published guidelines for dealing with matrices of 
this magnitude under the Analytical Hierarchy Process. However, it is 
questionable whether expending the effort to generate 100 random 
matrices of size 20 by 20 will be worth it. The concern in AHP is 
having consistency in the Pairwise Comparison Matrix, not whether it can 
be quantified or not. A suggestion for ensuring consistency of the 
Pairwise Comparison Matrix would be to gather the entire NARF Alameda 


P&E staff and utilize the Delphi method [Ref. 6] to find the zonal area 
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priority values. This methodology develops a consensus opinion of the 
entire group involved in the ranking task and thus eliminates the need 
to generate random matrices, or be concerned with monitoring 


consistency. 


D. SUMMARY 

In this chapter we have utilized the methodology of the Analytical 
Hierarchy Process to generate values which represent the contribution 
each zonal area makes to the criterion of general material condition of 
the S-3A aircraft. Unfortunately, we do not have an easy way to measure 
the consistency of opinion because of the difficulty of generating 
random matrices to obtain a comparison. This does not seem necessary 
anyway. The Delphi method [Ref. 6], developed by the Rand Corporation, 
can be used to aggregate the opinions of all involved P&E's and the 


results would, indeed, be consistent. 


ee PREVIEW 

In the next section we will develop an observable scale that can be 
used by the P&E evaluator when he conducts the S-3A ASPA inspection. 
This scale is necessary to reduce the P&E's evaluation of a specific 
aircraft to a single number, which is a step beyond the Analytical 
Hierarchy Process. The generation of a specific number to describe an 
aircraft's general material condition will make the SDLM induction 


decision much easier for NARF Alameda management. 
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V. DEVELOPMENT OF AN OBSERVABLE SCALE 


A. INTRODUCTION 

The Analytical Hierarchy Process provides us with the relative 
contribution each zonal area of the S-3 Viking makes to the general 
material condition of the aircraft. In the development of the observ- 
able scale we used the elements of the priority vector from the Pairwise 
Comparison Matrix to linearly weight the number and severity of the 
defects found by the P&E evaluator during the ASPA inepeeetanm The 
decision to linearly weigh the number and severity of defects was 
reached by consulting the S-3A Engineering Branch of NARF Alameda. This 
procedure was deemed the most workable weighting scheme at this time. 

The P&E evaluator, through knowledge and work experience, determines 
the lowest level of maintenance required to restore a discrepancy to its 
original condition. The levels of maintenance that are possible for 
assignment include the organization/squadron or O-level and _ the 
depot/NARF or D-level. The intermediate maintenance level is excluded 
as Aircraft Intermediate Maintenance Department(s) (AIMD) do very 
little, if any, structural corrosion repair work. 

In addition to the assignment of the maintenance level capable of 
repairing the discrepancy, the P&E evaluator assigns a defect code of 
minor, major or critical designation. These defect codes are defined by 
NAVAVNLOGCENINST 4730.7A [Ref. 3] as: 

Minor (Mi) - a defect that does not materially reduce the useability 


of the unit or part for its intended purpose nor is deferral! or 
correction likely to impose a disproportionate economic penalty. 
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Major (Ma) - a defect that materially reduces the useability of the 
unit or part for its intended purpose. Correction is subject to the 
operational/economic desires of the aircraft custodian but attention 
is recommended to regain essential operational capability. 
Critical (Cr) - a defect that constitutes a hazardous or unsafe 
condition or, as determined by experience and judgment, could con- 
ceivably become so relative to its deleterious effect on the 
aircraft or its operating personnel. 
An example of the P&E evaluator's worksheet is presented in Figure 16 
with assigned rework codes and typical discrepancies found during the 


zonal inspection of the fuselage. 


Pee ROCESS 

Based on the maintenance level/defect codes possible for assignment 
by the P&E (0/Mi, O/Ma, O/Cr, D/Mi, D/Ma, D/Cr) plus a category for "no 
defect", Figure 17 suggests a ranking of severity of defect from least 
severe (No Defect) to most severe (Depot/Critical). To quantify the 
ASPA process we have divided the priority vector elements of the 
Pairwise Comparison Matrix by six, the number of categories available 
for assignment by the P&E evaluator during an ASPA inspection, and 
multiplied this number by 10,000 to attain a linear weighting factor. 
For example, Zonal Area 15 (fuselage) has a priority value of 0.15007. 
This value divided by six and multiplied by 10,000 results in a point 
value equal to 250.12. 

This number represents the difference in weighting between each of 
the assignable categories. The "No Defect" category is assigned a value 
of zero points and "Depot/Critical", the most severe category, is 
assigned the full point value. Using Zonal Area 15 as an example, the 


point assignment breakout would be as follows: 
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No Defect 0 points 


Organizational Minor 250.12 points 
Organizational Major 500226 Poles 
Organizational Critical 700.35 pomnes 
Depot Minor 1,000.47 points 
Depot Major 13250.56 pounes 
Depot Critical 1,500.70 points 


To apply these weighting factors to the ASPA process we propose that 
the P&E evaluator total the number of discrepancies in each severity of 
defect category for each zonal area, and multiply this number by the 
appropriate category weight. For example, using Zonal Area 15, if the 
P&E evaluator discovered three Organizational Minor (0/Mi) discrepancies 
and two Depot Major (D/Ma) discrepancies, the Zonal Area ASPA score 


would be: 


PLS )( 250012 )- + (2)( Le 2 aoe sere 
Sicolle oe 
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The overall ASPA score would then be determined by summing all the 
zonal area ASPA score inputs. Table 3 presents the Quantitative ASPA 
Evaluation Scoresheet we have developed from the zonal area priority 
values. This scoresheet is designed to be used by the P&E evaluator 
after the ASPA inspection is completed. The P&E simply annotates the 
number of discrepancies by severity category, and performs’ the 
appropriate calculations to find the specific aircraft's ASPA score. 

Once the NARF Alameda S-3A Engineering Branch has collected a number 
of ASPA scores, a threshold score for determining the induction decision 
can be established. This threshold score could be found by comparing 


the ASPA scores of aircraft recommended for induction versus the ASPA 
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Scores of those aircraft that are extended on operational duty. The 
result of this comparison should be the generation of a maximum ASPA 
Score or threshold value. Aircraft which fall under this value will be 


extended and those which exceed it will be inducted into SDLM rework. 


C. SUMMARY 

In this chapter we have proposed a methodology to consolidate the 
rankings developed through the AHP into a single value for each in- 
Spected aircraft. We have not removed all of the subjectivity from the 
S-3A ASPA process but we have accomplished our goal of proposing a 
methodology for quantifying the S-3A ASPA program. The subjectivity 
that remains at this point is the P&E evaluator's selection of the 
appropriate defect category. By the very nature of the ASPA process, 


this choice must remain under the control of the P&E evaluator. 
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VI. SUMMARY, CONCLUSIONS AND RECOMMENDATIONS 


A. SUMMARY 

This study has focused on the quantification of the previously 
Subjective S-3A ASPA process. By first presenting a background and 
general overview of the ASPA concept, we have set the framework for 
analyzing the specific S-3A Viking ASPA process. We have discovered 
that the S-3A ASPA process is different than the ASPA process for all 
other Type/Model/Series aircraft in the Navy's inventory. The S-3A ASPA 
process evaluates zonal areas of the aircraft while the other 
Type/Model/Series aircraft use a leading indicator (i.e., specific 
component inspection) methodology during an ASPA evaluation. 

Since the S-3A ASPA process employs a zonal area evaluation 
technique we were forced to search for a unique methodology that 
approached the quantification problem in a logical and analytical 
manner. The model we have chosen is the Analytical Hierarchy Process 
(AHP) developed by Dr. Thomas L. Saaty. The AHP is based upon three 
principles of logical analysis. The principle Oi mes ERUGTUL ING 
hierarchies was carried out by adapting the ASPA concept to the AHP 
nierarchial structure. The principle of setting priorities required 
developing a Pairwise Comparison Matrix for the zonal areas of the S-3A, 
the values of which were determined by consulting an experienced P&E 
evaluator. This matrix was then mathematically manipulated to produce a 
quantitative measure of the relative priority each zonal area con- 


tributes to the SDLM induction decision. Finally, we attempted to apply 


oe 


the principle of logical consistency. Unfortunately, the amount of 
effort required was considered beyong the time available. 

Once the priority of each zonal area had been determined an 
observable scale was developed to reduce the P&E's rankings to a single 
number. In essence, this number described an aircraft's general 
material condition. After a suitable database has been collected, a 
threshold score should be able to be determined. Then, when a specific 
aircraft is inspected and its score assigned, the recommendation of 
induction/no induction can be determined by comparing the aircraft's 
ASPA score to the threshold value. A score above the threshold dictates 
the aircraft goes to rework and a score below the threshold indicates 


the aircraft can stay on operational duty (PED extension). 


B. CONCLUSIONS 

The quantified ASPA format that we have developed will eliminate 
most of the variation that now exists between the P&E's induction 
recommendations. By implementing our process the management staff of 
NARF Alameda will no longer have the problem of identifying the “hard” 
or “easy" grader. Even without being able to test for consistency, we 
feel that the process we have developed is workable and should be 
incorporated by NARF Alameda for quantifying the ASPA process for the 
S-3A Viking. 


C. RECOMMENDATIONS 
Specific recommendations to NARF Alameda include: 
(1) Attempt to reduce any inconsistency in the Pairwise Comparison 
Matrix for the S-3A by forming a task group to develop a 
consensus of the proper weights for each pairwise Comparison. 
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(2) Monitor the number of aircraft that pass/fail the quantitative 
ASPA inspection and ensure that the evaluation criteria are 
accurate and in conformance with the latest Navy directives. 


(3) Analyze any future ASPA inspection data that will be generated 
and make certain that consistency 1S maintained. 


The general material condition of the S-3A was the focus of this 
study. Although this factor was the only one evaluated in the ASPA 
process, we feel that other criteria should also be considered. These 
can easily be incorported into the AHP by the development of separate 
Matrices for each new criterion. Criteria such as cost, safety of 
flight and operational readiness are examples of areas that could be 


Studied. 
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APPENDIX A 






S-3A LOCAL ENGINEERING SPECIFICATION (LES) 


This appendix presents the NARF Alameda LES for the S-3A Viking 


aircraft ASPA program. 
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DEPARTMENT OF THE NAVY 
Naval Air Rework Facility 
Naval Air Station 
Alameda, California 94501 


Sl 220K 

7 Aug. 1985 

Page l of 6 
De ECe: S-3A Lacal Engineering Specification 
IDENTIFICATION/CLASSFICATION GEN/AL 12-9-0058 


SYSTEM: S-3A Aircraft 


SUBJECT: S-3A Aircraft Service Period Adjustment (ASPA) Inspection; 
guidelines for 


REFERENCE: (a) NAVAVNLOGCEN PATUXENT RIVER MD 011844Z NOV 82. 
(b) NALC Patuxent River MD Itr 3138/13023/8166 of 15 Mar 83 
(c) NALC Patuxent River MD Itr 405/4710/3118 of 25 Aug.83 
(d) CNO Washington DC 3017132 Dec 83 
(e) NAVAVNLOGCEN PATUXENT RIVER MD 201602Z Jan 84 
(f) NAVAVNLOGCEN PATUXENT RIVER MOD 1515332 Feb 84 
(g) NAVAIR O1-S3AAA-6 
(nh) NAVAIR 01-S3AAA-6-3 
(1) LES GEN/AL 02-2-0150 


ENCLOSURE: (1) Aircraft E & E Report 


1. PURPOSE:To define S-3A and derivative aircraft inspection 
procedures and requirements for a depot inspection team in the field 
to assess aircraft material condition and suitability for a 12 month 
increase to the present operating service period end date (PED). 


2-CANCELLATION: None. 


3. BACKGROUND: This directive was prepared as requested by 

reference (a),outlined in refs (b),(c), and (d), and modified by refs 
(e) and (f) to provide a disciplined procedure for maintaining positive 
control of aircraft material condition for aircraft REquEeS to be 
Operated beyond the present PED. 


4. APPLICATION: This directive applies to all S-3A and 

derivative aircraft requiring qualification for an increase to their 
current PED. The inspection specified in this directive shall be 
accomplished by a depot ASPA inspection team from a Depot Rework Point 
(ORP) as directed by the NAVAVNLOGCEN. The ASPA inspection must be 
Conducted within the six months prior to PED of an aircraft as 
requested by the reporting custodian, The ASPA inspection shal] 
result in either a recommendation that the aircraft be inducted in SDOLM 
within 90 days of PED or that the aircraft's PED be adjusted twelve 


montns beyond the current PED. Aircraft not recommended for deferral 
and not inducted within 90 days of PED shall be grounded. 


4.1L INSPESTION TEAM: A certified ASPA inspection team will be 
responsidie for accomplishing the inspection requirements and reporting 
the aircraft suitasility for a twelve month PED increase. Tne ASPA 
inspection team will consist of 


(a) One (1) Planner & Estimator 
(b) Appropriate Trade Skills as required. 


S.SPECTAC TOOLS AND TEST EQOTPMENT: a). Paint film thickness 
detector for Aiuminum Dase foundation (Vector 121 NDI Instruments Inc. 
or equivalent).b). Articulating Borescope. 

6.SPECTAC MATERIALS: None. 


TokPReClive DATE: 1 SEPT case 





S.INSTRICTIONS: The following instructions are guide linecmra: 

an Aitrcrart Service Period Adjustment (ASPA) inspection of aircraft 
for possible tour extension (s) beyond the peacetime Operation 
Service Period (OSP) Period End Date (PED). Tne ASPA inspection 
shall be performed at a snore facility designated by the aircraft 
controlling custodian. The ASPA inspection shall be performed by a 
Field Team - delineated in paragraph 4.1 of this specification. 
Organizational and Intermediate Level maintenance personnel wil] 
assist with the inspection as required. 


8.1 Aircraft Record Analysis. 


8.1.1 Review Maintenance Action Forms OPNAY 4790/41) Naval Aircraft 

Flight Records (Yellow sneets, OPNAY 3760/2) and the aircraft log book 
for identification of repeat problem areas, unusual conditions,or 
significant maintenance actions (including structural repairs). This 
historical performance shall be analyzed to determine possible chronic 
system and component trouble areas for added emphasis during aircraft 
examination. The squadron maintenance personnel familiar with the 
aircraft being evaluated shall be interviewed , whenever possible, to 
Gain additional information regarding potential problem areas or for 
Other considerations to be used in determining if an extension will be 
recommended. 


8.1.2 Review the Periodic Maintenance Information Conditional (PMICs) 
manuals, reference (g), Scheduled removal components for high-time 
components. 


8.1.3 Review the Technical Directives Section, (OPNAY 4790/24A), or List 
2 of the Aircraft Log Book to determine itncorooratad technica 
directives which would be required if the aircraft were extended. 


8.1.4 Examine Aircraft Log Book and available maintenance and historical] 
records to determine and record items listed below. This 
information shall be submitted to the Naval Air Rework 
Facility , Alameda, California, Code 311/312 after the ASPA 
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inspection nas been performed. 

8.1.4.1 Aircraft Bureau Number. 

8.1.4.2 Tour Number and present extension number. 

8.1.4.3 Total Operational service months and montnhs-in-tour. 
8.1.4.4 Last SDLM completion date. 

8.1.4.5 Total flignt hours and hours-in-tour. 


8.1.4.6 Number and Type of Landings (total), field, carrier, PiGieeemedin 
bolters. 


8.1.4.7 Number and type of arrestments (carrier and field). 
8.1.4.8 Number of catapults. 
8.1.4.9 Non-aging time accumulated since last SDLM. 


8.1.4.10 History of damage, overstress, hard/overweight landings, 
chronic or unusual, maintenance problems, special 
operaticonditions , and major component replacements. 


8.1.4.11 Last phase inspection and date. 


8.2 Detailed Inspection Requirements: Compliance with the following is 
required to determine.aircraft suitability for tour extension. 


8.2.1 Custodian wash aircraft in accordance with reference (hn) to 
prepare aircraft for inspection. 


a). Visually inspect entire paint system for evidence of : 


(1) Paint lifting (poor adhesion). 

(2) Blisters 

(3) Checked coatings, erosion and corrosion (especially 
around fasteners.) 

(4)Check the thickness of the paint film around areas that 
are listed below. (Using Vector 121 or equivalent) Use 
an average of three readings if there is wide discrepancy 
in the readings. 2 mils or less is cause for repainting. 


L/H aileron, center underside, BL 365. 

L/H wing top side, intersection of FS 338 and BL 94. 
L/H fuselage, intersection of FS 326 and BL 38.8 

R/H aileron, center, underside BL 365. 

R/H flap, center, underside BL 320 

R/H wing,top side intersection of FS 338 and BL 94 

L/H fuselage,intersection of FS 519.4 and WL 200 

L/H upper main landing gear , rear corner , FWO of and 
below of intersection of FS 496.6 and WL 200. 


JF7Jwmwano am oO oD 
o 0©e® © © © © @ 
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8.2.3 Open all 
on-site P & E). 
Inspect the following areas for cracks, 


fastene 


8.2.3.1 
a BP 
8. Zs 3.3 


8.2.3.4 


b). 
ae 


a) 


1. L/H fuselagegintersection of FS 333 0geanaewen iso 

j. R/H fuselage, intersection of FS 584.0 and WL 200. 

k. R/H main landing gear door, upper aft corner, FWO of 
and below of the intersection of FS 496.5 and WL 200. 

1. R/H fuselage,intersection of FS 333.8 and WL 180. 

m. R/H fuselage,intersection of FS 279.7 and WL 180. 


Perform wet and dry tape test as outlined in reference (i) 
Cosmetic appearance should not be considered. 


Repair capability is "0" os 


complete repainting. 


level for touch-up and level 


Inspect nose radome using tap test technique. 


a). 


Check each Radome for delamination and structural 


damage. 
Radomes found to Nave delamination flaws beyond tnree 
inches, but Tess than eight inches, in any direction must 
be repaired within 30 days. Radomes with delaminations in 
excess of eight inches in any direction must be replaced or 
repaired prior to the next flignt. All the above applies 
except in tne cao area, where any delamination flaws 

greater than three inches must be replaced or repaired prior 
to the next flight. 


b). Repair requires Depot Level Capability. 


PS, 


Interna] 
Interna] 


Fin Stub 


listed panels (and any other panels designated by the 
Access panels are noted by numbers in parentheses. 
corrosion, loose or missing 


loss of paint, paint blisters cleaniness, obstructed drain 
holes, and water 


entrapment. 
Upper Fin (9111-1 and 9131-1) 
Engine Pylon (10112-2 and 10131-1) 


Horizontal stabilizer cutout (7121-1,8121-1,6133-1,and 


Si3221) 


Internal rear fuselage (5133-1,5232-1, 5232-2) 


8.2.3.5Inspect inside the following wing panels and all flight control 
push rods, linkages, bearings, bushings, belleranks, and 
fasteners. : 


iloikq2 3213-4 3232-2 4213-1 4232-1 7231-1 
3123-1 3213-5 4123-1 4123-2 $232-2 8211-1 
3212-2 3231-1 4212-1 §213-4 4232-3 8211-2 
3212-4 3221-3 4212-2 4213-5 5111-1 8221-1 
3212-5 3231-6 4212-3 4231-3 6111-1 8231-1 
3212-6 3231-7 4212-4 4231-5 7211-1 9113-2 
3213-2 3231-9 4212-5 4231-6 121 te2 L0121-1 
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$213=3 S23 ce | 4212-6 4231-7 7221-1 10122-1 
8.2.3.6 With wings spread, cneck for binding in the following systems: 


) Trailing edge flaps 
) Leading edge flaps 
) Spoilers 

Ailerons 

Elevators 

Rudder 


aD AN Oe 


a 


reese 6. Fold wings and inspect: 
(a) Separable belleranks 
(b) Wing fold area. 


8.2.4 Remove sonobuoy reference system antennas, P/N 673096 from tne 
lower surface of the outer wing. Antennas are located at buttock lines 
258 and 340 on port and starboard wings. Inspect interior-circumference 
of exposed hole for corrosion. 


eee. 5 Inspect landing gear and wheel wells for corrosion, loose or 
missing fasteners and deformation. Pay particular attention to the nose 
landing gear launch bar assembly, trunnions, drag strutsupports,and 
mose jack fittings. 


e220 Inspect arresting gear hook well for cracks, corrosion, loose 
or missing fasteners, and deformation. Inspect left and right hand gear 
supports and fillet radii at the base of the supports for cracks and 
corrosion. 


8.2.6.1 Inspect arresting gear drag link. Inspect apex radii at base of 
the supports for cracks and corrosion. 


Gace / Remove panels 9123-2, and 9223-2. Inspect the structure about 
the Horizontal stabilizer support bracket, inspect for appearance of 
cracks in the fillet areas on the angle and lower beam structure aft of 
“the horizontal stabilizer support hinge, pay particular attention to the 
right side. 


8.3 Evaluation and Reporting. 


8.3.1 Record requirements and inspection results on the Aircraft E— & E 
Report, enclosure (1). The report shall identify all defects. 
Documentation shall include identification of the LES inspection which 
led to the defect discovery. The ASPA inspector and an authorized 
representative of the reporting custodian are to sign the Inspection 
Summary Report. A signed copy of the report shall be provided to the 
reporting custodian and to the Naval Air Rework Facility, Code 310 and 
312, Naval Air Station, Alameda, California 94501. Tne CFA copy must 
include tje WUC applicable to each individual discrepancy,the 
malfunction code, and the when discovered code. The when discovered code 
shall indicate wnen the defect should nave been discovered if the ASPA 
had not been performed. The WUC and these codes are only required for 
Critical and Major items. 


Gy 


8.3.2 Notify Weapons Systems Engineering Division, Code 310, of any 
unusal damage founded, that iS not associated with aircraftageor 
service history. For example: indication of primary structure 
overstress. Code 311 will determine subsequent inspections and repairs. 


8.3.3. The Planner-Estimator on the ASPA Inspection Team , will prepare 
a Naval Message Report on site. Neitner Organization nor Intermediate 


Level defects are to be reported in this message. Included arethe 
following in the message text: 


(a) TMS BUNO 

(Oe PeD 

(c) Tour 

(d) Total operating service months. 

(e) Total operating hours this period 
(f) Total arresting landings this period 
(g) ASPA inspection date 

(nh) Number of ASPA inspections in tour 


(i)Number of man-hours expended in the ASPA inspection 
(Org/Intermediate/Dept) 


(j)Description of critical and major defects which require 
depot resources for repair with an estimate of total man 
hours. 


(kK) Recommendation: A brief narrative as to the suitability of 
the aircraft for an ASPA change to the PED, based on the 
overall] aircraft condition. Do not assume that any or all 
defects will be corrected. 


(1) Distribution: 


a). TYCOM 

b). COMNAVAIRSYSCOM WASHINGTON 

ae NAVAVNLOGCEN PATUXENT RIVER MD 

d). NAVAIREWORKFAC ALAMEDA CA. 
ATTN; CODE 0214, 311, 312, S2lyos5) ec. 


8.3.3.1 Tne ASPA decision will be made by the TYCOM based on the 
message report and in consultation with NAVAYNLOGCEN Depot Management. 
Disposition of any depot repair requirements will be in accordance with 
Current emergency repair procedures. 


8.4 Defects which require depot facilities/equipment to correct, shall 
be noted in the Aircraft Log Book “Miscellaneous History" section. 
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APPENDIX B 
S-3A VIKING ZONAL AREAS 


This appendix presents a pictorial view of the various zonal areas 


of the S-3A Viking aircraft. 
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ZONAL AREA 1 
ZONAL AREA 2 
ZONAL AREA 8 
ZONAL AREA 9 





WING FOLD 


LEFT HAND WING 


LEFT HAND WING FOLD: OUTER WING PANEL 

LEFT HAND WING FOLD: INNER WING PANEL 

LEFT HAND TNNER WING PANEL SPAR AND FLAP WELL 
LEFT HAND QUTIER WING PANEL AFT SPAR AND FLAP WELL 
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WING FOLD 
RIGHT HAND WING 


ZONAL AREA 3. RIGHT HAND INNER WING PANEL SPAR AND FLAP WELL 
ZONAL AREA 4 RIGHT HAND OUTER WING PANEL AFT SPAR AND FLAP WELL 
ZONAL AREA 5 RIGHT HAND OUTER WING PANEL, TAB AND SPAR 

ZONAL AREA 6 RIGHT HAND WING FOLD: OUTER WING PANEL 

ZONAL AREA 7 RIGHT HAND WING FOLD: INNER WING PANEL 
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ZONAL AREA 10 





ZONAL A 
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STABILIZER 


ZONAL AREA 10 HORIZONTAL STABILIZER 
ZONAL AREA 11 LEFT HAND ELEVATOR AND TAB 
ZONAL AREA 12 RIGHT HAND ELEVATOR AND TAB 


ZONAL AREA 14 


ZONAL AREA 13 





TAIL FIN 


ZONAL AREA 13. FIN FOLD 
ZONAL AREA 14 RUDDER 
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ZONAL AREA 16 


FUSELAGE 


ZONAL AREA 15 FUSELAGE 
ZONAL AREA 16 ECS COMPARTMENT 
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ZONAL AREA 18 ZONAL AREA 17 





MAIN LANDING GEAR 


ZONAL AREA 17 LEFT HAND MAIN LANDING GEAR AND WELL 
ZONAL AREA 18 RIGHT HAND MAIN LANDING GEAR AND WELL 
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NOSE LANDING GEAR 


ZONAL AREA 19 NOSE LANDING GEAR AND WELL 
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S-3A VIKING AIRCRAFT 


ZONAL AREA 20 OVERALL AIRCRAFT PAINT CONDITION 
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